Check a prototype of 2nd version of this platform
being developed by cKnowledge.org in collaboration with
MLCommons.
compare_experiments mlperf
ck-action:compare_experiments mlperf (v3.0.0)
License: BSD 3-clause (code) and CC BY-SA 4.0 (data)
Creation date: 2019-03-12
Source: GitHub
cID: 081173242a88bc94:b584cfab2f2ccc60
Don't hesitate to get in touch if you encounter any issues or would like to discuss this community project!
Creation date: 2019-03-12
Source: GitHub
cID: 081173242a88bc94:b584cfab2f2ccc60
Description
- Automation framework: CK
- Workflow: MLPerf benchmarking - common functionality
- Development repository: ck-ml
- Source: GitHub
- How to get the stable version via the CK client:
pip install cbench
cb download module:mlperf --version=3.0.0 --all
ck compare_experiments mlperf --help - How to get the development version:
pip install ck
ck pull repo:ck-ml
ck compare_experiments mlperf --help
- How to run from Python:
import ck.kernel as ck
r=ck.access({'action':'',
'module_uoa':'',
... See JSON API below ...
})
if r['return']>0: return r
...
- Module description: Validate MLPerf submission against reference
- API Python code: Link
- JSON API:
" Input: { (cids[]) - up to 2 CIDs of entries to compare (interactive by default) (repo_uoa) - experiment repository ('*' by default) (extra_tags) - extra tags to search for CIDs } Output: { return - return code = 0, if successful > 0, if error (error) - error text if return > 0 } "